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POOLMS - A COMPUTER PROGRAM FOR FITTING AND MODEL SELECTION 


FOR TWO-LEVEL FACTORIAL REPLICATION-FREE EXPERIMENTS 
by Geraldine E. Amling and Arthur G. Holms 
Lewis Research Center 
SUMMARY 

A statistical , multiple-decision procedure called chain pooling has been des- 
cribed in an earlier report. The procedure's application is model fitting to 
two-level, factorial, fixed-effects, replication-free experiments. It uses a con- 
ditional number of mean squares for estimating error variance and for testing 
for real effects , where the number is conditioned on the relative magnitudes 
of the mean squares . POOLMS is a computer program that performs the operations 
of the procedure in accordance with user-specified levels of type 1 or type 2 
error probabilities . 


INTRODUCTION 

Some of the most efficient experiments that can be designed are the two- 
level, fixed-effects, crossed-classification , full or fractional, factorial experiments 
without replication . Some methods for the design of such experiments , par- 
ticularly when allowing for sequential experimenting in the presence of block 
effects , have been described in references 1 to 5 . The economy achieved by 
not replicating carries the penalty that the experiment might not provide a valid 
mean square for estimating error variance . Such an estimate is needed , if 
parameter estimates are to be judged significant or insignificant according to 
well-established statistical procedures . 

The absence of an obviously valid estimate of error variance has led to the 
development of several alternative procedures , all possessing some degree of 
heuristic appeal , with most of them being accompanied by some amount of Monte 
Carlo evaluation (refs. 6 to 11) . 



The present report gives a qualitative comparison of these procedures , which 
leads to the conclusion that chain pooling (refs. 10 and 11) is the procedure that 
should be most generally preferred for model selection applied to data from the 
type of experiment already described . 

Following the qualitative comparison of the alternative procedures , a computer 
program , POOLMS , is described . It is a program designed specifically to do the 
computations required by the model-selection procedure referred to as chain pool- 
ing . The complete program listing is given and described , together with detailed 
descriptions of the input and the output . The use of the program is illustrated by 
an example , for which a detailed statistical discussion is given in references 10 
and 11. The reader should consult reference 10 for an understanding of the sta- 
tistical basis of POOLMS and , therefore , for an understanding of the capabilities 
and limitations of the decision procedure provided by POOLMS . Whereas refer- 

4 

ence 10 deals only with the analysis of 2 design experiments, reference 11 deals 

5 6 

also with the analysis of 2° and 2° design experiments . Computations for any of 
them are provided by POOLMS . 


Mathematical FORTRAN 

symbol name 

g 

h 

i I 


j 


J 


k K 

£ L 


m 


M 


SYMBOLS 

Description 

Number of factors in two-level experiment 
Fractional replicate contains (1/2)* 1 ob- 
servations of full factorial experiment 
Subscript denoting order of computing 
mean squares according to yates' algorithm: 

i = 0, 1, 2, . . 2 £ - 1, I = 1 2**L 

Subscript denoting the j smallest mean square 
(exclusive of grand mean) : j = 1 , 2 , . . . , 

2* - 1 
Subscript 

g - h: Experiment contains 2^ treatment combina- 
tions and produces that many observation sets 
Number of mean squares pooled before testing 
begins 


2 



FORTRAN 


Description 


Mathematical 


symbol 

name 

R 1 


R 2 


U. 

J 

TB 

X 


y 

Y(I,K) 

z 

Z(...) 

a 


“f 

NY 


KF 


KP 

a 

P 


V 


V 

JETA 

"i 


A 

"i 

B (I) 

P 


P 

IRHO 


a 

CT 


Risk associated with type 1 errors 
Risk associated with type 2 errors 
Test statistic 

Levels of independent variables 

Response variate: 1 = 1 2**L; 

K = 1 , . . . , NY 
Mean square 
Test size 

Nominal size of final significance test 

Number of observations averaged for each 
treatment (maximum of six) 

Final test size index , KF = 1 10 (see 

section on INPUT) 

Preliminary test size index , KP = 1 , . . . , 11 
(see section on INPUT) 

Nominal size of preliminary pooling test 
Number of mean squares having noncentrality 
parameter of zero 
Estimate of r\ 

Coefficients of model equation that are estimated 
in Yates' order with Yates' contrasts 
Estimate of p. 

Number of real effects 
Estimate of p 
Standard deviation 
Estimate of a 


ALTERNATIVE MODEL-SELECTION PROCEDURES 

For two-level , fixed-effects , factorial experiments without replication , a suit- 
able practice consists, according to Davies (ref. 12) , of pooling some arbitrary 
number of the highest order interaction mean squares into an estimate of error 
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variance . When this is done , any of these high-order interactions that are not 
actually small or any unknown block effects (major changes in experimental condi- 
tions not accounted for by the model) could inflate some of the pooled interactions 
and thereby give too large an estimate of error variance . Too large an error esti- 
mate reduces the sensitivity of subsequent tests . 

The preservation of sensitivity , when pooling mean squares into the estimate 
of error variance , has been an object of the procedure of Daniel (ref. 7) and of 
Wilk, Gnanadesikan , and Freeny (ref. 9). 

Daniel (ref. 7) uses the absolute values of the effect estimates as order sta- 
tistics . They are plotted on probability paper , and the result is called a half- 
normal plot. In addition to conditional structuring of the ANOVA model, Daniel's 
objectives included the determination of "bad values, heteroscedasticity , dependence 
of variance on mean , and some types of defective randomization , . . . " The half- 
normal plot , combined with a background of experience , might provide a method 
by which a skillful user could pass judgement on the results of an experiment . 

Daniel concluded that such a plot can be used to make judgements about the reality 
of the largest effects observed only if a small proportion of the effect estimates 
represent real effects. Birnbaum (ref. 8) investigated procedures related to half- 
normal plotting. His results on ". . . the probabilities of the various possible 
sorts of errors ..." are limited to the single largest order statistic. He surmised 
that if only a small number of effect estimates have nonzero means, the power and 
sensitivity properties will tend to hold approximately . 

n 

The procedure of Wilk, Gnanadesikan, and Freeny (ref. 9) if used with 2 
treatments is benefited if some subjective or prior knowledge is used to decide 
that t) of the 2^-1 mean squares do not contain real effects or that p = 2 £ - 
r\ - 1 mean squares do contain real effects . As was shown in reference 9 , their 
procedure is not robust against errors in guessing the value of 17 , and v 
must be guessed if the prior knowledge is lacking . Chain pooling does not require 
a prior knowledge of v- The procedure gives an estimate of v. 

Zahn (ref. 6) presented results of a Monte Carlo study of Daniel's original 
version of the half-normal plot and two modifications of it when as many as six 
real contrasts of size lc r to 8<x are present in a 2 ^^,p-q = 4, factorial ex- 
periment. Zahn considered the power, false positive behavior, and variance 
estimation of these versions of the half-normal plot when they are applied to 
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the general problem in the case n = 15 , since there are 15 contrasts of interest , 

4 

ignoring the grand mean, in a 2 factorial experiment. He then pointed out that 
these versions, or obvious modifications of them, can be used for any n. 

Zahn, Birnbaum, and Daniel (refs. 6 to 8) have limited their results to experi- 
ments where only a small proportion (at most 6 out of 15) of the effects are antici- 
pated to be significant . On the other hand , situations can exist where the experi- 
menter might use a two-level , fractional , factorial experiment designed such that 
a large proportion of the effects are significant . These situations are met by the 
procedures of references 10 and 11. 

As stated by Birnbaum (ref. 8) the optimal decision procedure when p ^ 1 
uses a test developed by Cochran (ref. 13). The (originally in Yates' order) 
are ordered (omitting the mean square for the grand mean) according to non- 
decreasing magnitude and renamed Z.: 


Z < Z < . . . < Z. < . . . S z 
12 j n 


Cochran's statistic is: 


C = 
n 


n 


Z 1 + . . . + Z 
1 n 


and the null hypothesis is rejected with test size a if C r exceeds the upper 100 
a -percent point of Cochran's distribution, which has been additionally tabulated 
(ref. 14) . 

As pointed out by Zahn (ref. 6) the operating characteristics of the decision 
procedures that have been intended for p 2 1 deteriorate rapidly with p > 1 . 

But in addition to dealing with the situation of p > 1 , the model-selection procedure 
must also deal with the possibility that not all the nonzero effects are of equal 
magnitude . As shown in table 6 . 2 of reference 6 , the detection rate for two means 
of size 4 a, 6 a , or 8 a is usually reduced in the presence of two other means of 
size 2cr, 4 a, or 6 cr , respectively, from the value it would have been in the 
presence of two other means of the same size, namely 4a, 6a, or 8a, respectively. 
Because inequality of the means is clearly a disadvantage , the question arises 
as to what is the least favorable distribution of these means . As developed in ref- 
erence 10 , a normal distribution of these means would be highly unfavorable . 
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Accordingly , the procedures of references 10 and 11 were developed empirically 
to be optimal when the means do have an approximate normal distribution . Further- 
more , the prior assumption of a normal distribution for these means in the general 
experimental situation does not seem to be unreasonable . Thus , as pointed out 
in reference 11, the Monte Carlo founded procedures of references 10 and 11 can 
be regarded as being empirically optimized against both what is highly likely to 
occur and what would be highly unfavorable if it did occur . Therefore these pro- 
cedures should be regarded as being approximately both Bayes and minimax optimal. 

OUTLINE OF COMPUTING PROBLEM 

This description of the computing problem is divided into four steps: (1) read 

the input data and provide some elementary conditioning if required, (2) compute 
parameter estimates and associated mean squares, (3) perform the model selection, 
and (4) write the output. 


Input Data 

Two-level , full or fractional experiments are sometimes performed in a manner 
that provides superficial rather than true replication. For example, if the treatments 
are each applied to different specimens but the dependent variable is observed 
through duplicate measurements on each of the specimens , such replication does 
not measure the specimen-to-specimen variability . A conservative procedure would 
be to compute the means of the repeated measurements and then proceed with these 
mean values as if they were observations from an experiment with no replication . 

The first step of the program computes the mean values in such cases of superficial 
replication . 

A logarithmic transformation of the dependent variates is also provided. 

Parameter Estimates and Mean Squares 

The second step of the program computes parameter estimates (effects) and 
mean squares according to Yates' method (ref. 12). (Because these estimates are 
estimates of coefficients in an equation where the levels of the independent variables 
are represented by +1 and -1, the coefficients have one-half the absolute values of 
the "effect" estimates of ref. 12.) 
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Model Selection 


The third step of the program is to invoke the model-selection procedure des- 
cribed in references 10 and 11. This is done by ordering the computed mean squares 
in the ascending order of their magnitudes and simultaneously setting up a pointer 
function (IND(J)) that will relate the ordered mean squares to the model parameter 
estimates that they contain . The test statistic is then computed . With the statis- 
tician having specified m , the statistic consists of a denominator containing the 
m + 1 smallest mean squares and a numerator containing the m + 1 smallest mean 
square . The program then performs a table look-up to compare the test statistic 
with the tabular entry for nominal significance level and m + 1 degrees of 
freedom . The computation of test statistics and table look-up at significance level 
Op or with j degrees of freedom then continues as required by the sequential 
procedure and branching of references 10 and 11. 


Output 

On completion of the decision procedure , the fourth step of the program is 
writing both the input and output data. The input data include (1) the number of 
treatment combinations, namely, 2^; (2) the value of KODE to show whether a log- 
arithmic transformation was used; (3) the strategy (m, o^, and o^); and (4) the 
input observations . The output data include (1) the smallest mean square selected 
as being significant and the associated values of rj and p, (2) the treatment 
identifications (if any) and associated transformed observations; (3) the regression 
coefficient estimates; (4) the ordered mean squares; and (5) the pointers that match 
the ordered mean squares with the regression coefficients . 

PROGRAM DESCRIPTION 

The working part of the program is described in this section . The input and 
output are described subsequent to the description of an example illustrating the 
use of the program . 

The program is concerned with the 2* sets of observations corresponding to 
the 2^ treatments of the experiment . These sets must be in the correct order for 
Yates' method. If there is more than one observation in a set for any treatment, the 
observations in the set are first averaged to form one "observation" per treatment. 
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The "observations" are then operated on according to Yates' method (ref. 12) to 
compute the parameter estimates. The algorithm for Yates' method is described as 
follows. 

The "observations" y. . may be visualized as a column (j = 1) with row index 
0 1 ’- 1 

i = 1, . . . , 2 . The column is then operated on according to Yates' method to 
produce a succession of columns j = 2 , . . . , S. . The successive columns for any 
k ir row are computed as follows: 


y k,j y i+l,j-l + y i,j-l 


i = 1, 3, 5, . . . , 2 s - - 1 
k = 1, 2, 3, . . . , 2^/2 


y k,j y i+l , j -1 y i,j-l 


i = 1, 3, 5, . . 2* - 1 


k = (2^/2) + 1, (2 £ /2) + 2 2 11 


New columns are computed according to the two preceding equations for 
j = 2, . . . , $. (to create f columns) . The program performs these operations 
(appendix A) following the comments card "CALCULATE MEAN SQUARES BY YATES 
METHOD ." Furthermore, an array of pointers to the B(I) array is created by the 
statement IND(I) = I. This array will serve to identify the coefficients in the B(I) 
array after the process of ordering mean squares according to rank . The ordering 
is done in the sequence of statements 10 to 13. 

Operations thus far have created a column of mean squares Z(J) with mean 
squares indexed on J in the order of increasing rank , together with a column of 
integers IND(J) indexed on J. Thus, any address J will lead to a mean square 
Z(J) and also to the integer IND(J) . This integer is the index I that the associated 
regression coefficient has in the original Yates' order. 

Now, ordered according to rank, the mean squares are subjected to the hy- 
pothesis testing as given by the statements following the comment "DO HYPOTHESIS 
TESTING." These operations require that the program contain the critical values 
against which the test statistic is to be compared . The table of 620 critical values 
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consisting of the test statistic lb (table I) plus 20 dummy values is stored internally 
in the program as TB(64,10) . Also stored internally are the 11 values of nominal 
test size ALPHA, ranging from 0.001 to 1.0, with the first 10 being the column head- 
ings for U. in table I. (The values of a =1.0 and associated KP = 11 are simply 
J P 

a code for the strategy of terminating the pooling with the prior chosen number of 
m smallest mean squares . ) 

The hypothesis testing operations are displayed by figure 1 . (The initial pool- 
ing of m mean squares is performed in the loop "DO 15 J = 1, M".) 

Statement 17 is the final test of significance. If significance is observed, it has 
occurred when J = JA , as recorded at statement 19 . The significant mean squares 
are that particular one, Z(JA) , and all that are as large or larger. Thus, the num- 
ber of mean squares decided to be insignificant is rj = JETA; and the number (aside 
from the grand mean) decided to be significant is p = 2^ - fj - 1 = IRHO , as given 
in the statement following 20 . 

ILLUSTRATIVE EXAMPLE - COBALT-BASE-ALLOY DEVELOPMENT, ONE-HALF 

RELICATE WITH FIVE FACTORS 

The statistical implications of the example to be described were discussed at 
length in references 10 and 11. In those references the analysis was presented 
from two points of view . The first , or significance point of view , assumed that the 
statistician was mainly interested in controlling the probabilities of making type 1 
errors. The second, or screening point of view, assumed that all effects that might 
be real should be so identified and that therefore the statistician was mainly in- 
terested in controlling the probabilities of type 2 errors . In either case , the model 
selection proceeded in two stages . The first stage began with the strategy m = 1 , 
which led to an estimate rj of the number of null mean squares . Based on this 
estimate, a second iteration of the procedure was performed with m > 1. 

In the present discussion, the use of the computer program is illustrated only 
for the significance point of view and only for the iteration with m = 1 . 

The responses y. (table II) are logarithms of stress-rupture times to failure 
of cast specimens (J i =4). The parameters to be estimated (table II) include one 
grand mean , five main effects , and 10 interactions . 

The strategy (m , « , c^) is chosen according to information on the operating 
characteristics given for m = 1 by figure 2 . The use of these curves requires that 
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a prior estimate be made for rj . For this example , the number of null mean squares 
is assumed to be equal to the number of highest order interactions; namely, the 
assumption is rj = 10. 

In addition to making a prior estimate of r \ , the use of the curves of figure 2 
requires that some assumptions be made about the value of the type 2 risk, R 2 (\) • 
Because the operating characteristics with m = 1 are not sensitive to the value of 
X, the curves of figure 2 are closely spaced with respect to i? 2 (\) , and therefore 
a single arbitrary value (the middle curve for R 2 (\) = 0.10) is used. 

Because the type 2 risks should always be minimized , the largest value 
that will not result in too large a value of should be chosen. Since the oper- 

ating characteristics with m = 1 are inferior to those with preferred m > 1 
(fig. 3) , the statistician should be less stringent about R^( T ?) when using m = 1 than 
when using preferred m > 1 . Under the previously stated assumptions concerning 
RgfX) , the strategy (m, a^) will be chosen from figure 2 according to the 

resulting value of (f] ) . 

With m = 1: 

(1) Assume that r\ = 10 and K 2 (\) = 0.10. 

(2) In figure 2(a), (£ =4) with 77 = 10 and R 2 (\) = 0.10, choose the highest 
ctf that yields an acceptable R^( 7 ?) and note the required a Figure 2(a) shows 
that if Of = 0. 01, Ri(\) is 0.14 and a;p is required to be 0.25. 

(3) The strategy to be used is (m , otp , c^) = (1 , 0 . 25 , 0 . 01) , which is used as 
input . 


INPUT 


Card type 1 . One card with two values read with FORMAT (315) containing: 
KODE (In first field' Either 0 or 1 . If KODE = 0 , Y is used . 

If KODE = 1, log Y is used. 

L (In second field) Power of 2 to denote number of treatments. 

Card type 2 . - As many as 64 cards (2**L cards) , with two to eight values 
on each card , read with FORMAT (A6 , 16 , 6F6 . 0) containing: 

DATAID (In first field) Treatment identification (may be omitted) . 

NY (In second field) Number of responses (Y values) to be 

averaged 

Y (In subsequent fields) Response variates . 
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Card type 3 . One card for each (m , a , a^) strategy , with three values read 
with FORMAT (315) containing: 


M 


(In first field) 


Number of mean squares pooled before 
testing begins . 

Column number (table I) of a . 


Column number (table I) of a 


V 

a to get corresponding value of KP; for example, if 

Sr 


<2p = 0.25, 


KP (In second field) 

KF (In third field) 

Example . Use 

KP = 8. Use to get corresponding value of KF; for example, if Q^= 0.01, 

KF = 4. If several strategies (m, c^, a^) are to be tried, card type 3 is the only 
card that needs to be changed . The card input pertaining to the illustrative example 
is shown by figure 4 . 


OUTPUT 

The manner in which output is printed is illustrated in appendix B . The value 

of SL (which is determined by the number of observations) is given by the heading 

"2**L EXPERIMENT" and in the present example L = 4. Next in the headings are 

the input values of m, a , and a c . The raw data or observations are listed under 

P f 

the column headings Y (1) , Y (2) Y (6) . 

The decision procedure is illustrated by figure 1 and is described in the section 
PROGRAM DESCRIPTION. The decision procedure ends (statement 17 of fig. 1) when 
the value of U. computed from the mean squares exceeds the critical value of U. 
as tabulated for the stated value of o^. At this point, J = JA and the values of rj 
and p are computed from JA and printed , as indicated , by IRHO = 7 and JETA = 8 
(appendix B) . The particular mean square that tested as significant at J = JA 
(statement 17) is printed with the label Z(JETA + 1) = 2.8594 E-02 (appendix B) . 

The subsequent columns are as follows: DATAID is the physical label given to 
the treatments producing the observations. Y (I) is the transformed input value 
resulting from the observations and is the actual value used in Yates' algorithm. 

I is the subscript identifying the regression coefficients (parameter estimates) as 
listed in Yates' order under the heading B(I) , and J is the index of the mean 
squares as ordered in increasing order in the column headed Z(J) . (The mean 
square associated with B (0) , that is , the mean square associated with the grand 
mean, does not participate in the decision procedure and is not listed in the Z(J) 
column . ) 


11 


The last column is the pointer array IND. It gives the subscript I of the re- 
gression coefficient that corresponds to the tabulated mean square . Thus , for the 
smallest mean square IND = 10 and so B(10) = 2.2307E-03 is the parameter estimate 
with smallest absolute magnitude . The number of mean squares concluded to be 
insignificant was rj = JETA = 8. The smallest significant mean square was Z(J) = 
Z(JETA + 1) = 2.8594E-02, for which j = 9 and IND = 12. Thus, the smallest signifi- 
cant coefficient is B(12) = 4.2274E-02. All the other significant coefficients are 
found by continuing downward under the IND column, and their subscripts (as 
read from the IND column) are IND = 11, 14, 3, 4, 8, 2, in increasing order of 
significance . 

The output as illustrated by appendix B has been summarized in table II . 

Lewis Research Center, 

National Aeronautics and Space Administration , 

Cleveland, Ohio, November 1, 1972, 

501-21. 
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APPENDIX A 
PROGRAM LISTING 
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lt>4)* S ( t 4 ) « Z(C4). Tb(fc4«l0J« AL PhA ( 11)* Y l { £ 4 « o ) 
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S*b*8S«c*/ / d»b«ol * i i«o/^«S*7A*-j#i>7 / • ci 7 t /•iito«^Ot!)«bif 

xl 4*7 / * 3 »d / o • i / »V*b7*^*/i » b • o d f h • i o »/♦.■) / # 0 * 7 i 1 
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APPENDIX B 
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TABLE I. - UPPER 100a PERCENT POINTS OF TEST STATISTIC U. 


Nominal test size, a 


0.005 0.01 


0. 10 0. 25 0. 50 


Nominal test size index, KP or KF 



1 

2 

3 

4 

5 

6 

7 

8 

9 

2. 00000 

1.99999 

1.99997 

1.99986 

1.99917 

1.99687 

1.9877 

1.923 

1. 706 

2.9976 

2.9960 

2.9904 

2.9809 

2.951 

2.904 

2.806 

2.527 

2.086 

3.976 

3.962 

3.925 

3.870 

3.760 

3.625 

3.412 

2.949 

2.395 

4.887 

4.845 

4.758 

4.65 

4.44 

4.21 

3.89 

3.287 

2. 658 

5. 74 

5.63 

5.46 

5.31 

4.99 

4.68 

4.28 

3.57 

2.893 

6.51 

6.33 

6. 11 

5.87 

5.46 

5.09 

4.61 

3.83 

3. 11 

7.20 

6.96 

6. 65 

6.35 

5.88 

5.44 

4.91 

4.06 

3.29 

7.81 

7.52 

7. 10 

6.78 

6.26 

5.75 

5. 17 

4.27 

3.45 

8.34 

8.01 

7. 53 

7.17 

6. 59 

6.03 

5.41 

4.45 

3. 60 

8.82 

8.44 

7.95 

7.53 

6.89 

6.28 

5.61 

4.62 

3.74 

9.26 

8.84 

8.33 

7.87 

7. 13 

6. 50 

5.81 

4.77 

3.87 

9.67 

9.21 

8.68 

8.16 

7.37 

6.71 

5.99 

4.92 

3.99 

10.05 

9.55 

8.95 

8.42 

7.59 

6.91 

6.15 

5.05 

4. 10 

10.40 

9.86 

9.20 

8.66 

7.79 

7.07 

6.30 

5.17 

4.20 

10. 72 

10. 14 

9.43 

8.83 

7.96 

7.23 

6.44 

5.29 

4.30 

11.01 

10.40 

9.64 

9.00 

8. 12 

7. 38 

6.57 

5.40 

4.39 

11.28 

10. 64 

9.84 

9.17 

8. 28 

7. 52 

6.69 

5. 50 

4.48 

11. 53 

10.86 

10. 03 

9.34 

8.43 

7.65 

6.81 

5.60 

4. 56 

11.76 

11.07 

10.22 

9.51 

8. 58 

7.78 

6.92 

5.69 

4.64 

11.98 

11.28 

10.40 

9.67 

8.72 

7.90 

7.03 

5. 78 

4.71 

12. 19 

11.48 

10. 58 

9.83 

8. 86 

8.02 

7. 13 

5.87 

4.78 

12.39 

11.68 

10.76 

9.99 

8.99 

8. 13 

7.23 

5.95 

4.85 

12. 58 

11.87 

10.93 

10. 14 

9. 12 

8.24 

7.33 

6.03 

4.92 

12.76 

12.05 

11. 10 

10. 29 

9.23 

8.34 

7.42 

6. 11 

4.98 

12.93 

12.22 

11.26 

10.43 

9.34 

8.44 

7.51 

6. 18 

5.04 

13.09 

12.38 

11.41 

10. 56 

9.44 

8.54 

7.60 

6.25 

5. 10 

13.24 

12.53 

11. 55 

10.68 

9.54 

8.63 

7.68 

6.32 

5. 16 

13.39 

12.68 

11.68 

10.78 

9.64 

8.72 

7.76 

6.38 

5.22 

13.53 

12.82 

11.80 

10.88 

9.74 

8.81 

7.83 

6.44 

5.28 

13.67 

12.96 

11.91 

10.98 

9.83 

8.89 

7.90 

6.50 

5.33 

13.80 

13.09 

12.01 

11.07 

9.91 

8.97 

7.97 

6. 56 

5.38 

13.93 

13.21 

12. 10 

11. 16 

9.99 

9.04 

8.04 

6.62 

5.43 

14.05 

13.32 

12. 19 

11.25 

10.07 

9. 11 

8. 11 

6.68 

5.48 

14. 17 

13.43 

12.27 

11.34 

10. 15 

9. 18 

8. 17 

6.74 

5. 53 



























Nominal test size, a 


Number of 


denomina- 
tor mean 
squares, 

0.001 

0.002 

0.005 

0.01 

0.025 

0. 05 

0. 10 

0.25 

0. 50 

0.75 



Nominal test size index, KP or KF 




j 

1 

2 

3 

4 

5 

6 

fl 

8 

9 

10 

36 

14.29 

ESI 

1 

Ksg 

10.22 

9.25 

8.23 

6.80 

5. 58 

4.66 

37 

14.41 

SH 


in 

10.29 

9.31 

8.29 

6.85 

5.63 

4.70 

38 

14.53 

13.73 

12.51 

Eta 

10.36 

9.37 

8.35 

6.90 

5.67 

4.74 

39 

14.64 

13.82 

12. 59 

11.67 

10.43 

9.43 

8.41 

6.95 

5.71 

4.78 

40 

14.75 

13.91 

12.67 

11.75 

10. 50 

9.49 

8.46 

6.99 

5.75 

4.82 

41 

14.85 

14.00 

12.75 

11.83 

10. 57 

9.55 

8. 51 

7.03 

5.79 

4.86 

42 

14.95 

14.09 

12.83 

11.90 

10.64 

9.61 

8. 56 

7. 07 

5.83 

4.90 

43 

15.05 

14. 17 

12.90 

11.97 

10. 70 

9.67 

8.61 

7. 11 

5.87 

4.94 

44 

15. 15 

14.25 

12.97 

12.04 

10.76 

9.72 

8.66 

7. 15 

5.91 

4.98 

45 

15.24 

14.33 

13.05 

12. 11 

10.82 

9.77 

8.71 

7. 19 

5.95 

5.01 

46 

15. 33 

14.40 

13. 12 

12. 18 

10.88 

9.82 

8.76 

7.23 

5.99 

5.04 

47 

15.42 

14.47 

13. 19 

12.25 

10.94 

9.87 

8.81 

7.27 

6.03 

5.07 

48 

15. 50 

14. 54 

13.26 

12.32 

11.00 

9.92 

8.85 

7.31 

6.07 

5. 10 

49 

15. 58 

14.60 

13.32 

12.38 

11.06 

9.97 

8.89 

7.35 

6. 11 

5. 13 

50 

15. 66 

14.66 

13.38 

12.44 

11. 11 

10.02 

8.93 

7.39 

6. 14 

5. 16 

51 

15. 73 

14.72 

13.44 

12. 50 

11. 16 

10. 07 

8.97 

7.43 

6. 17 

5.19 

52 

15.80 | 

14.79 

13. 50 

12.56 

11.21 

10. 12 

9.01 

7.47 

6.20 

5.22 

53 

15.87 

14. 85 

13.56 

12.62 

11.26 

10. 17 

9.05 

7. 51 

6.23 

5.25 

54 

15.93 

14.91 

13.62 

12.68 

11.31 

10.21 

9.09 

7.55 

6.26 

5.28 

55 

15.99 

14.97 

13.67 

12.73 

11.36 

10.25 

9. 13 

7.59 

6.29 

5.31 

56 

16.05 

15.03 

13.72 

12.78 

11.40 

10.29 

9. 17 

7.63 

6. 32 

5.34 

57 

16. 11 

15. 10 

13.77 

12.83 

11.44 

10.33 

9.21 

7.67 

6.35 

5.37 

58 

16. 17 

15. 16 

13.82 

12.88 

11.48 

10.37 

9.25 

7.70 

6.38 

5.40 

59 

16.23 

15.22 

13.87 

12.93 

11. 52 

10.41 

9.29 

7.73 

6.41 

5.43 

60 

16.29 

15.28 

13.92 

12.97 

11.56 

10.45 

9.33 

7.76 

6.44 

5.46 

61 

16.34 

15. 34 

13.97 

13. 01 

11.60 

10. 49 

9.37 

7.79 

6.47 

5.48 

62 

16.39 

15.40 

14.02 

13.05 

11.64 

10. 53 

9.41 

7.82 

6. 50 

5. 50 

63 

16.44 

15.46 

14.06 

13.09 

11.67 

10. 57 

9.45 

7.85 

6. 53 

5.52 































TABLE H. - ILLUSTRATIVE EXAMPLE OF ONE -HALF 2° DESIGN EXPERIMENT 


Treatment 

levels 

Responses, 

a) 

2.2715 

ae 

2. 0708 

be 

1.3745 

ab 

1.2458 

ce 

2.2810 

ac 

2.0950 

be 

1. 5207 

abce 

1. 5290 

de 

1. 8199 

ad 

1. 5687 

bd 

.7947 

abde 

1.2701 

cd 

2.2006 

aede 

1.9759 

bede 

1. 1924 

abed 

1. 2240 


Parameter 
estimates, a 

*i 

Mean 

squares, 

z i 

1.6522 


-. 0297 

0. 000079 

-.3833 

. 000103 

.0781 

. 004408 

. 1002 

.007567 

-.0166 

.014160 

-. 0025 

. 018099 

-.0217 

.020248 

-. 1464 

. 021949 

.0336 

. 028594 

-. 0022 

.032091 

.0448 

. 043254 

.0423 

. 097554 

-.0356 

. 160510 

-.0520 

.342750 

-.0370 

2.350200 


Significance point of view 


First analysis with Second analysis with 

(m, a p , a? f ) = 1, 0. 25, 0. 01 (m, a p , a f ) =5, 1.0, 0. 01 


U.(exper.) U-(a p ) U.(a f ) U-(exper.) U^ofp) U.(a f ) 


1.1319 1.923 1.99986 

b 2. 8810 2.527 2.9809 

2.9295 

2.9619 

2.9701 

2.9733 


2.9753 
c 2. 9810 


2.4449 

2.6090 

2.7285 
3. 1244 
3.2966 
3.7303 

4.7253 
5. 1548 


fj. ^ are contrasts divided by 2 . 
Significant at level a p . 
Significant at level <*f. 


Do 18 J = MP1, KTM1 
FN ■ N 

TEST = FN*Z(J}/(TEM + Z(J)) 


Jf (TEST - TB(N, KP))16, 16, N. 


16 TEM = TEM + Z(J) 
N = N + 1 
Go to 18 


17 If (TEST -TB(N, KR)18, 18, N 


18 Continue 
JA = KT 
Go to 20 


19 JA = J 


20 JETA = JA - 1 
IRHO = KT JETA - 1 


Figure 1. - Flow chart for tests of hypotheses. 





































Number of null mean squares, 





Figure 3. - Type 1 risks with preferred 
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